Empirically Estimable Classification Bounds Based on a Nonparametric Divergence Measure
نویسندگان
چکیده
منابع مشابه
Empirically Estimable Classification Bounds Based on a New Divergence Measure
Information divergence functions play a critical role in statistics and information theory. In this paper we show that a non-parametric f -divergence measure can be used to provide improved bounds on the minimum binary classification probability of error for the case when the training and test data are drawn from the same distribution and for the case where there exists some mismatch between tr...
متن کاملBounds on Nonsymmetric Divergence Measure in terms of Other Symmetric and Nonsymmetric Divergence Measures
Vajda (1972) studied a generalized divergence measure of Csiszar's class, so called "Chi-m divergence measure." Variational distance and Chi-square divergence are the special cases of this generalized divergence measure at m = 1 and m = 2, respectively. In this work, nonparametric nonsymmetric measure of divergence, a particular part of Vajda generalized divergence at m = 4, is taken and charac...
متن کاملA Symmetric Information Divergence Measure of the Csisz r's f -Divergence Class and Its Bounds
K e y w o r d s P a r a m e t r i c measure, Nonparametric measure, Csiszg~r's f-divergence, Information measure. 1. I N T R O D U C T I O N There are several types of information divergence measures s tudied in l i te ra ture which compare two probabi l i ty d is t r ibut ions and have appl icat ions in informat ion theory, s tat is t ics and engineering. A convenient classification to differe...
متن کاملFast nonparametric classification based on data
A new procedure, called DDα-procedure, is developed to solve the problem of classifying d-dimensional objects into q ≥ 2 classes. The procedure is completely nonparametric; it uses q-dimensional depth plots and a very efficient algorithm for discrimination analysis in the depth space [0, 1] . Specifically, the depth is the zonoid depth, and the algorithm is the α-procedure. In case of more than...
متن کاملFast nonparametric classification based on data depth
A new procedure, called DDα-procedure, is developed to solve the problem of classifying d-dimensional objects into q ≥ 2 classes. The procedure is completely nonparametric; it uses q-dimensional depth plots and a very efficient algorithm for discrimination analysis in the depth space [0, 1] . Specifically, the depth is the zonoid depth, and the algorithm is the α-procedure. In case of more than...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Signal Processing
سال: 2016
ISSN: 1053-587X,1941-0476
DOI: 10.1109/tsp.2015.2477805